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Abstract 

We describe a non-Arrhenius mechanism for slowing down of dynamics that 
is inherent to the high dimensionahty of the phase space. We show that such a 
mechanism is at work both in a family of mean-field spin-glass models without 
any domain structure and in the case of ferromagnetic domain growth. 
The marginality of spin-glass dynamics, as well as the existence of a 'quasi 
equilibrium regime' can be understood within this scenario. 
We discuss the question of ergodicity in an out-of equilibrium situation. 
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I. INTRODUCTION 



Many systems of physical interest are out of equilibrium throughout the observation 
times after preparation. The fact that a system rather than reaching the Gibbs-Boltzmann 
equilibrium measure remains in a regime of slow dynamics can be attributed to various 
causes. A clear example is the case in which there are domains of different ordered phases 
growing at the expense of each other, as when a ferromagnet is quenched to the low tem- 
perature phase. Another rather different scenario is when the phase-space has traps of long 
lifetimes, which the system leaves without visiting again. 

Spin-glasses (and also structural glasses) are known to have properties that depend on 
the 'age' after the quench and hence the possibility that they are in equilibrium is ruled 
out. Several explanations have been proposed to account for their slow dynamics, based on 
domain growth ideas 0, on a phase space with traps 0] and on a percolation-like picture in 
phase-space [^,0. The latter two scenarios are low-dimensional in the sense that they work 
equally well in a low dimensional (though infinite) phase-space. 

The purpose of this paper is to argue, with some examples, that just as equilibrium 
thermodynamical properties such as the existence of macroscopic non-fluctuating quantities 
are a direct consequence of the infinite dimensionality of phase-space (irrespective of the 
physical dimensionality D), there are also in the out of equilibrium dynamics aspects that 
are inherent to the geometry of infinite-dimensional (phase) spaces. 

We shall first describe these rather generic geometric features, and then show explicitly 
how they lead to slow dynamics, even in the absence of metastable states. We shall see that 
they apply to both ferromagnetic domain growth and to a family of mean-field spin-glass 
models which does not have any domain structure. In both cases we shall concentrate on 
'long but finite times': the limit N ^ oo (or V —>■ oo) is made before the limit t —>■ oo. 

In order to have a well defined landscape in which a deterministic dynamics takes place, 
we shall restrict our discussion to zero or near-zero temperatures. We believe that the 
mechanism we shall describe is also at work in the case of higher temperatures, possibly co- 
operating with other specifically non-zero temperature mechanisms such as barrier crossing. 
The three models we shall use as examples have the property that their dynamics at zero 
and at low temperature are essentially the same. 

The problem with extending our geometrical discussion to finite temperatures is that at 
present we do not know exactly the geometry of what we should look into (that is, short of 
the whole Hilbert space of the Fokker-Planck equation). In this respect, a usual thing is to 
have in mind a /ree-energy landscape in terms of variables representing the evolution of a 
probability packet. Whatever the procedure for the construction of such a landscape, the 
implicit assumption is that the dynamics is deterministic in these variables (otherwise the 
original energy landscape would be as good). 

There seems to be, however, discouraging evidence for this approach, at least for glassy 
systems: It has been shown that a set of trajectories that are forced to coincide up to any 
given finite time, and are then subjected to different thermal noises will eventually diverge 
to distant places of the phase space, while with a deterministic approach one would conclude 
that the they evolve together. In other words, a probability packet that is out of equilibrium 
is destroyed by the evolution. 

We shall concentrate on systems with a smooth energy-density landscape with no relevant 
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infinite energy density configurations. Let us define the normalized square phase-space 
distance between two configurations sf , s^: 

1 ^ 

B{a,b) = -j:{st - s'lr (I.l) 

i=l 

or, for two fields (f)"'{x), (f)^{x): 

B(a, b) = - c/^x(0"(x) - (1.2) 
V Jo 

The correlation function is introduced in the usual way, 

B{a, b) = C{a, a) + C{b, b) - 2C{a, b) (1.3) 

We shall say that a system has well-separated energy minima if B{a,b) between any two 
minima is an 0(1) quantity, or: 

^(o-'') <1 (1.4) 



[C{a,a)C{b, 6)]i/2 



In the case of non-zero temperature the corresponding question is whether the correlation 
between magnetizations in two states is smaller than one: 



Some examples of systems with well-separated minima are the ferromagnet and ferro- 
magnetic Potts models in any dimension and mean-field spin-glasses with finitely many 
breakings. Instead, mean-field spin-glasses with infinitely many levels of replica symmetry 
breaking do not satisfy this condition. Our discussion is mainly directed at systems of the 
first kind. 

We shall exemplify the geometrical properties we discuss here with three models. The 
first one is a ferromagnetic domain-growth problem (see [§] for a review). The energy is of 
the Landau type 

E{<P)= Jd^'x Q(V0)^ + \/(0)) (1.6) 

where V has a double-well structure with minima at = ±1 (Fig.l). We take V(±l) = 
0, and consider a system of side L and periodic boundary conditions. In order not to 
have regions of phase-space with infinite energy densities we shall assume that there is an 
ultraviolet cutoff. The dynamics is gradient descent: 

-V'4>{x)~V\4>{x)) (L7) 



dt S(l){x] 
starting from a random configuration. 
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FIG. 1. Domain growth potential V{(j)). 



Secondly, we shall discuss the spherical version of the Sherrington-Kirkpatrick model 



E{s) 



N 

E 



= N 



(1.8) 



where the Jij are quenched random Gaussian variables with zero mean and variance l/y/N 



This model shares some, but not all |11] of the properties of 'true' mean-field spin-glasses, 
but has the advantage that it allows for a complete analytical description. 

The third model we shall consider is a 'true' spin-glass, in that it has slow dynamics 
and aging effects, and its Gibbs measure is given by a (one step) replica-symmetry breaking 
Parisi solution. It is the p-spin version |]12[ of the preceding model p > 2: 



Eis) 



E 

ii<i2<---<ip 



Jil,...ipSi-^...Si^ 



N 

E' 

i=l 



N 



(1.9) 



where the Ji^,...ip are quenched random Gaussian variables with zero mean and variance 
p\/2N^~^\ In the large N limit one can assume that the sum runs over different indices. 
In these two last cases we also consider a Langevin dynamics 



dsi 6E 



(I.IO) 



where z{t) is a Lagrange multiplier enforcing the spherical constraint, and rii{t) are random 
uncorrelated white noises with variance 2T. We shall deal mostly with the zero-temperature 
case. 

Our strategy will be to show that what rather obviously happens in the first two models 
also happens in a more hidden way in the third, and hence argue that such mechanisms are 
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at work also in glassy dynamics. This will allow us to understand some puzzling aspects 
of the aging regime in this kind of system, such as the existence of a 'quasiequilibrium' 
(FDT) regime of times even in a well out of equilibrium situation, and the ubiquity of the 
so-called 'marginality condition' which allows to use pseudo-static methods to obtain certain 
dynamical quantities. 

The paper is organized as follows. In Section || we discuss some geometric properties 
of an infinite-dimensional phase space, and describe how they may lead to a long-time 
out-of-equilibrium dynamics. In Section |T| we show how these considerations apply to 
the ferromagnetic domain-growth case. The Hessian this case corresponds to a Schrodinger 
problem of 'quantum wires'. In Section ^ we review some results of ref. |Tl| for the spherical 
Sherrington-Kirkpatrick model. This model is also very similar to the domain growth of the 
0{N) ferromagnet. A complete study of the topology of phase-space is extremely simple for 
it, and in addition we can get a glimpse at the effect of non-zero temperature. 

Section |V| contains the main results of this paper. We study there the p- spin spherical 
model {p > 2), which is 'really glassy', in the sense that its dynamics has an aging regime 
with long term memory effects qualitatively close to realistic spin-glasses. The equations 
of motion are in the high temperature phase exactly mode-coupling equations. The Parisi 
ansatz for the replica solution has breaking of the replica symmetry and the phase-space 
has exponentially many valleys [^,15]. We shall rederive some results of the analytical 
solution of |jl3| on the basis of the present geometrical scenario, and compare them with the 
static approach. 



II. CRITICAL POINTS, BASINS AND BORDERS 

Borders 

Let us start by describing the structure of the phase-space of a system with several 
valleys. First consider the 'critical' or 'stationary' points in which the gradient of the energy 
vanishes. The nature of a critical point is given by the number of negative eigenvalues of 
the energy Hessian, which we shall call the 'index' I of the point. The minima (we assume 
there are at least two) have index zero, the maxima have index A^, and the critical points of 
index one are the saddle points connecting two minima. We shall consider the rather general 
situation in which there are critical points of every index. We shall denote the 'index density' 
i = I/N, 0<i<l. 

To each minimum is associated a basin of attraction, defined as the set of points that will 
flow through gradient descent to it. Consider now the A^ — 1 dimensional border of a basin, 
which we shall denote it di. There may be one or several such borders. Now, a point that is 
strictly on a border will never leave the border (by deflnition!). Generically, the trajectory 
will end in a minimum over di of the energy. Such minima over di are precisely critical 
points of index one, the saddles separating two true minima. 

Hence, we have that di is itself divided into basins of attraction, one for each critical 
point of index one in it. Consider now the N — 2 dimensional border of one such basin. We 
shall label it 82- Again, a system starting in 82 (the border of the border) will never leave 
it. Repeating the argument for 82, we flnd that it is divided in basins whose minima are the 
critical points of index two. In this way we can iterate the argument A^ times, and define 
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di, the border of the border of ... (/ times), on which the trajectory generically flows to a 
saddle point of index J. 

All this description may seem rather baroque, given that most points are not on borders. 
However, when we consider an infinite-dimensional phase space, the structure of borders 
becomes relevant for the following reason: A random starting point will be contained within 
a basin. Now, since such basin is an A^-dimensional object, we know that generically most 
of its volume is contained within B ~ 1/N of its border di |T^. This in turn means that for 
iV = cxo if the potential is smooth enough the system never leaves the vicinity of di in finite 
times. 

The random point being almost on di, we can repeat the argument to find that it will 
also be very close to a certain 82-, ... etc. We can now iterate this argument a finite number 
of times, to find that the system is near a sequence di, ...,di. 

We can now understand the origin of the slowing down of the dynamics: A system 
starting strictly on dj will end up by being stuck in a critical point of index I. A system 
starting near dj will be almost, but not completely stuck, and it slows down. For long times 
we have that the trajectory manages to distance itself from dj corresponding to degrees 
of 'bordism' / that are smaller and smaller but still i = 0(1) never distancing itself from 
dj corresponding to finite /. In other words, the neighborhoods of the critical points of 
z ~ are for long but finite times efficient in trapping the system. Figure 2 shows how this 
would come about in a two dimensional phase-space: points starting near the borders have 
trajectories that take long to reach the minimum (of course, the condition of starting near 
the border is imposed in two dimensions, while it arises naturally in many). 




(■■) (+-) 

FIG. 2. A schematic representation of a basin in 2D phase-space. The signs indicate the 
indices '/' of the critical points (maxima are vertices and the minimum is at the center of 
the square). The trajectories starting near an edge take longer to fall. The dotted line 

represents schematically the 'border'. 

What we have described is a non-Arrhenius mechanism for aging which works even at 
zero temperature, and which does not involve any sudden processes of barrier jumping. This 
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mechanism, as we shall see below, is at work in the case of domain growth; the important 
question here is that it seems rather generic for systems with well separated minima, whether 
we are able to identify a spatial structure for them or not. 
Hessian 

At long times one knows that the gradient must be small (because the system has slown 
down), but is still non-zero so that we are not precisely in a critical point. Indeed, at zero 
temperature: 

' ' (it ^ ^ 

If we now consider the matrix of second derivatives of the energy, 

we know that in a neighborhood of a critical point of index / the Hessian has / negative 
eigenvalues. A natural assumption suggested by the scenario described above is that if 
we follow a trajectory that starts near dr the spectrum of the Hessian will be similar at 
every time to that of a nearby critical point, reflecting the degree of 'near bordism' at that 
time. This is easy to see in Fig. 2, a trajectory starting near the border will have typically 
one positive and one negative eigenvalue, until it 'unsticks' from the border and it ends by 
having two positive eigenvalues. 

The dynamics at long times will be such that the H will have a distribution of eigenvalues 
containing R{t) negative eigenvalues, with R{t) decreasing with time, corresponding to 
a situation in which the landscape at time t is similar to the landscape at a nearby critical 
point of index / = R{t). The density of the eigenvalues of the H at time t, pt(A) will then 
contain a bulk of positive eigenvalues, plus a tail extending down to some small negative 
minimal eigenvalue. The integral over the tail of negative eigenvalues is R{t). The precise 
manner in which pt{X) tends to its limit Poo('^) is model-dependent, we shall describe them 
in detail below for the three models discussed in this paper. The main features are, however, 
the same: a distribution over positive A that stabilizes quickly, plus a tail that extends up 
to negative eigenvalues which tends to disappear slowly with time. 

Let us see that the velocity vector points, for long times, in the directions of low (positive 
and negative) eigenvalues of the Hessian. If there is slower than exponential decay of the 
energy, we have that 

(yE)mVEl_d'E dE 

Denoting t'^ the component of the velocity in the direction of the eigenvalue A^ of H, this 
means that: 



(11.4) 



Hence, we have that at long times, the particle moves in a gorge with locally many 
directions in which it is a minimum, plus a few almost flat directions whit positive and 
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negative curvatures: the system is 'critical' or 'marginal' at all finite times. The gradient 
is small, and is pointing along the almost-flat subspace. We have arrived at this picture by 
arguing that the dynamics takes place along ridges, and we now find that remarkably, in 
high dimensions, a ridge can behave also as a channel. It is important to remark that the 
claim here is not that at long times there should be slow degrees of freedom (this is obvious), 
but that the existence of such slow directions is a natural consequence of the dominance of 
borders in high dimensionalities. 

Energy differences betvi^een critical points, speed of descent. 

Let us now review a few results that will be useful in the discussion that will follow. 

Given two critical points of index / and / + respectively, which are joined by a gradient 
line (e.g. a minimum and a saddle), we want to estimate what the energy difference of such 
a 'step' may be. Consider a 'ladder' of such steps, taking us from a minimum to a saddle, 
from a saddle to a critical point of index 1 = 2, and so on up to a maximum. If the system 
does not have infinite energy density configurations, the total energy climbed is 0{N), in 

steps. Hence, at most a finite number of such steps can be of 0{N), and there must be 
steps of 0(1). This means that most of these steps are almost fiat. 

For D dimensional systems with short range interactions we can say more. By considering 
a domain of a phase A growing against a domain of another phase B, one finds that: 

i) If there is a minimum whose energy is 0{N) above another minimum, the energy of 



the barrier separating them is 0(1) |17 



ii) Between two minima there is at least one saddle (index 7 = 1) that is at most 
0{N^~^^^) in energy above them. 

Let us now give an upper bound for the time of descent between two points. Consider 
a point in phase-space s*^, and another point s* which is downhill from along a gradient 
line. Let their energy difference (energy density difference) be AEab (Acab = AEab/N), and 
distance ciafe = — 

We now ask ourselves what is the minimal possible time for descent from a to b. It is 
easy to show that the time is minimal if the path joining a and b has constant gradient 
= AEab/ dab- Hence we have: 

ta^. > = ^ (II.5) 

- AEab Aeab ^ ' 

Consider now two minima and their associated saddle point (/ = 1), and let each minimum 
be well separated from their common saddle B {saddle, minimum) > 0. An immediate 
consequence of ( |II.5| ) is that if the energies differences between barriers and minima scale 
with the system size slower than A^, the time for descent from the neighborhood of the saddle 
to the neighborhood of either minimum is infinite. This argument certainly holds for finite 
dimensional systems with short range interactions, since for them Ae{barrier, minimum) < 
O(Ar-VS). 

Furthermore, since as we have seen before the gradient lines joining most critical points 
have energy differences of order smaller than A^, we find that if two such critical points are 
well-separated the time of descent from neighborhoods of each is again infinite. 

Ergodicity 

Having claimed that the motion takes place near borders, we must reconsider what 
is it that we shall understand by 'ergodic component' in an out-of equilibrium situation. 
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Suppose we call 'ergodic component at time t' the connected set of points that includes the 
configuration s(t) and have an energy lower or equal than E(t) i.e. the set of points to 
which the system can be driven without work. 

Let us now argue that an ergodic component so defined includes at any finite time many, 
and in systems with finite spatial dimensions, all minima: At time t, there are within the 
ergodic component several points of index / = 1, having various energies. Each time E{t) 
reaches the energy of one of these points, the constant-energy surface develops a separatrix 
and there is a disconnection of a subset of the ergodic component. 

It may happen that many (or even all) the critical points of index one are at an energy 
of order smaller than above the minima. Indeed, this will be always the case with finite 
spatial dimensions and short range interactions. Now, the excess energy E{t) — E(t = oo) 
is of 0{N) at any finite time. In that case the ergodic component never disconnects and it 
includes all the minima at any finite time t: the dynamics is such that the system refuses 
to break its ergodicity at finite times. 

At non-zero temperature we can discuss ergodicity at a given time from a related but 
different point of view by asking ourselves whether a configuration at a given time t is 
doomed to fall in an assigned state, or it may change basin due to thermal fluctuations at 
times > t. That is, we are asking if the 'target' state is fully determined by the conflguration 
at time t. 

We cannot answer this question in general, but in section |V| we will show in a particular 
model that there is at any given flnite time a non-zero probability of changing basin - and 
this long before the system has had time to cross barriers between minima. One can suspect 
that this is quite general, given that at any flnite time the system has descended very little 
from the ridge separating basins (it is close to di) so the thermal fluctuations may well make 
it jump across the ridge and head for a different state. 

'Quasi-equilibrium' regime and marginality 

A rather surprising feature that appears in spin glasses, is that if one observes the 
correlation and response functions at two long but not very separated times, they depend 
on time- differences and obey the fluctuation-dissipation theorem (FDT), just as in a system 
in equilibrium - even if the system is visiting a region of phase-space to which it will never 
return. 

This can be understood within the scenario described above: the fast relaxations are 
dominated by the local directions with large second derivatives. The form of pt(A) for 
large times determines the precise time-dependence of these relaxations. The slow drift 
phenomena are related to the motion along the almost flat subspace, i.e. the tail of p(A) 
for A around zero. The fact that the 'quasi-equilibrium' correlations and response functions 
depend on time-differences reflects the fact that the form of pt(A) for A well above zero 
stabilizes quickly, the 'channel walls' in most directions preserve their form. 

Another surprising question in mean-fleld spin-glass dynamics is the so-called 'marginal- 
ity condition'. In its original form [Q, the marginality 'principle' stated that the dynamical 
values of energy, susceptibility, and the so-called 'anomaly', are determined by the require- 
ment that the fast relaxations (in the FDT regime) be 'critical' or 'marginal', in the sense 
that they follow power laws instead of exponentials. The dynamics considered there was 
made manifestly out of equilibrium (though not aging) by making the Hamiltonian itself 
(slowly) time-dependent. Because in many models the dynamics in a true equilibrium state 
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is non-critical, the results so obtained differ from those at equilibrium for them. 

It also turned out (although no general proof exists at the moment), that one can obtain 
the large-time limit of some one-time quantities by solving a static problem and imposing 
the solution to have marginal stability |[18|JI3[ . 

The question seems very puzzling: why should the system always choose to fall in a state 
that is marginal, refusing to see those that are not? Within the present geometrical scenario, 
the question is quite clear: the dynamics is by construction non-equilibrium, at least at the 
beginning, even if we always consider a time-independent Hamiltonian. Then we argue that 
the system never achieves (even local) equilibrium, it doesn't fall anywhere, but is confined 
near borders of the basins and the Hessian at long times contains a (decreasing) number 
of negative eigenvalues. In this sense the dynamics is automatically at all times marginal, 
whatever the stability of the true minima. 

If the minima are 0{N) below the borders, we will then observe a finite energy-density 
difference with respect to them at any finite time. This last thing cannot happen in finite- 
dimensional systems, but it does happen in the mean-field model we shall discuss in section 
|V[ In that section we shall discuss this question in more detail. 

The origin of a 'quasi-equilibrium' regime and the marginality of the long time dynamics 
are easy to understand in the case of ordinary domain growth: The response and the corre- 
lation function at small time-differences are dominated by the bulk of the domains, which 
are locally (in real space) in equilibrium. The marginality of dynamics is given by the zero 
modes associated with moving a domain wall. Again, the main point here is that by con- 
sidering the phase space geometry we can understand why these things happen in systems 
which either do not have a real space domain structure, or of whose real space structure we 
do not know. 



III. DOMAIN GROWTH 

Let us see how the description in the preceding section applies to the case of ferromagnetic 
domain-growth 0, eq. (p7|). For definiteness we restrict ourselves to two dimensions. 

We denote the size of the system V = L"^, and L —>■ oo. This case is somewhat compli- 
cated by the fact that there is translational invariance, and hence the discussion has to be 
done modulo translations. 

The model has two zero-energy ground states 0(x) = ±1, which we depict in FigS.b in 
black and white, respectively. For long times, the system consists of domains of the two 
types separated by sharp domain walls (FigS.a). The energy over the minima is at long 
times proportional to the total length of all domain walls, which is at finite times O(L^). 

The phase-space square distance to the ± minima is given by: 



(III.l) 



At time t the typical domain size is r{t), and by hypothesis we are in the regime r{t) « L 
(FigS.a), so that 5(0, ±) is ~ 2 at all finite times. The system clearly remains far from 
either minimum. 

The saddles separating minima are easily constructed: they correspond (FigS.c) to di- 
viding the volume in two equal pieces of opposite phases, with straight interfaces. There 
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are two continua of such saddles, obtained by translation and 90° rotation. Their energy is 
0{L), so that at any finite time the energy of the system is way above the energy required 
to go from one basin to the other. 





FIG. 3. a) a domain configuration 
b) the two states (j) — —1 and (f) — +1 
c) a saddle configuration. 

The Hessian matrix in the phase-space point 0(a;) is the operator: 



S(f){x)S(f){y) 



(111.2) 



The eigenvalues A^^ and eigenvectors ■0^^ of the Hessian evaluated in are then obtained from 
the Schrodinger problem: 



[-V^ + V"{cl>{x))]^l;,{x) = XMx) 



(HI.3) 



with 'potential energy' given by V"{(j){x)), and periodic boundary conditions for the wave 
functions. The Schrodinger potential is a well that follows the domain walls and rapidly 
tends to ~ V"{±1) away from them. Figure 4.b shows the Schrodinger potential across a 
domain wall. 

In order to obtain the complete spectrum, let us first consider a single, straight wall. 
Translational invariance tells us that 



ijjo{x) = (f)'{x) 



(IH.4) 



is a bound eigenvector of the Schrodinger potential with A ~ 0, which corresponds to shifting 
the wall. In the saddle point configuration of FigS.c (where two domain walls are present), 
we have that the A = eigenvalue is precisely (f)'{x), which is an odd function localized near 
the two domain walls. Since this function has a node, there must be a lower eigenvector 



11 



which is similarly localized but even: its eigenvalue is then negative, and it corresponds to 
moving the two domain walls in opposite directions. 

We can now discuss the structure of the Hessian at large times. The Schrodinger potential 
consists then of thin wells that follow the domain walls. The structure of bound eigenvalues 
of such a problem can be appreciated easily by noting that it corresponds to a problem of 
'quantum wires' (a 'wire' being the region of each domain wall), a problem of localization 
that has been extensively studied in the literature | |19| ]. 
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FIG. 4. a) 0(x) across a domain wall 
b) The Schrodinger potential V^"(0) = m^(0) of the corresponding domain wall 
c) Schrodinger wave function ipx = with A ~ across the domain wall. 

The eigenvectors of H fall into three classes: 

i) all eigenvectors with > V"{±1) are unbound. They are simply the bulk oscillations 
of the magnetizations, and are little affected by the domain structure. 

ii) there are the bound eigenvectors which in the direction perpendicular to the walls 
of the domains are essentially like ( [111.4| ) (Fig4.c), and oscillate like e*'^"' in the direction 
w along the walls. Their eigenvalues are proportional to k"^, and they correspond to the 
massless spectrum of fluctuations (of length 1/k) of the domain walls. 

iii) finally there are negative eigenvalues localized |]T9| in the more curved regions of the 
domain wall, with eigenvalues A ~ — where r is the local curvature of the domain wall 
in the region of localization (these are the localized states of the quantum wire problem). 

At any finite time there is then in addition to the 'bulk' of large eigenvalues (i), a 
tail of small, positive (ii) and negative (iii) eigenvalues. Clearly, as time passes all local 
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curvatures become smaller and the domain walls become more and more sparse, so the 
negative eigenvalues tend to approach zero and simultaneously the distribution of eigenvalues 
contains less and less eigenvalues smaller than < V"{±1). 

The 'velocity vector' ^ is in real space concentrated along the regions of fastest variations 
of 0, i.e. in functional space it mainly points in the direction of (ii) and especially (iii). 

The fast response is dominated, at large times, by the eigenvalues > V"{±1), and 
coincides with the one obtained at equilibrium. 



IV. SPHERICAL SK MODEL 

The spherical p = 2 model has been introduced in , where it was shown that its statics 
has a low-temperature phase with two states. The replica solution does not have replica 
symmetry breaking. The long time dynamics |10|,[Tl]] has two regimes of times: 



i) for t,t' — i> oo and t — t' finite the correlation and response functions are time- 
translational invariant, and satisfy FDT: 

C(t,t') = CFDT(t-t') 

R(t,t') = R,oT{t-f) = ^?^^2^i^ (IV.l) 

with C{t,t) = 1 

For large t — f, but still «t, 

Cfdt ^ QEA + A{t - t')-^'^ ; Rfdt oc {t - t'Y^'^ (IV.2) 

where qea = 1 — T is the Edwards-Anderson parameter. At strictly zero temperature 
(lEA = 1, so that in order to see something of the decay of the correlation, and to check 
FDT, in this regime we will have to go to small but non-zero temperature. 

ii) The system is not, however in equilibrium at any finite time: In the regime of large, 
comparable, times in which t,t' oo and < t'/t < 1 the correlation function is a 
non- homogeneous function of t'/t, while FDT is violated (see ref. |]1 1|| ) . 

Let us see how the considerations of section |T| apply to this case. The energy of the 
model, defined by the Hamiltonian ( p8|) reads, in the basis in which the matrix Jij is 
diagonal: 

e = -\t.J,^1 (iv.3) 



with the spherical constraint 



Y.sl = N (IV.4) 



where are the eigenvalues of Jjj, which for large are distributed with a semicircle 
law with support (—2, 2) [^. Let us denote si, S2, sn the directions associated with the 
eigenvalues in decreasing order (Ji ^ 2, ^ —2). 

The stationary points of when restricted to the sphere, are the directions of the 
eigenvectors. There are two minima = ±-\/iV5^^i, two saddle points separating them 
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= ±viV(5^^2, and in general two critical points of index I: = -LyNS^j. The energy 
difference between the minima and the saddles is easily shown using the semicircle law to 
be oiO{N^/^). 

The equation of motion in terms of these variables is, at zero temperature: 

^ = (J, - z{t)) s,{t) (IV.5) 

We assume that the initial configuration s is uncorrelated with the potential, and hence 
in the eigenbasis of Jij each is a random number of 0(1). The solution to the equations 
of motion then is: 







(J^ - z{T))d 



T 



(IV.6) 



where 

3 

z{t) - 2 - — as oo (IV. 7) 

From ( [lV.6yiV.^ ) one sees that si(t) does not change sign and its absolute value grows 
steadily. Hence, the two basins of attraction are the set of points: 

s / si> 

s / si < (1V.8) 

The border di is then the set di = {s / Si = 0}. Repeating again the argument, we 
conclude that di is itself divided into to basins leading to the two saddles. The border 
between these is ^2 = {s / Si = , $2 = 0}. In general dk = {s / Si = 0, = 0}. 

The normalized squared distance to di is B{di, s{t)) = Si(ty/N, and remains of 0(1/A^) 
at all finite times. In general, this is true for the distance to dj (/ finite), given by: 

B{dj,m) = j^j:s,{tr (iv.9) 

k=l 

We now turn to the study of the Hessian. Because the system is spherically constrained, 
we have to restrict it to the directions along the sphere. A direct way to see which is the 
relevant operator is to consider the dynamics of two trajectories that are close to one another: 
s{t) and s{t) + (?(t), with \a\ small. Using the equations of motion and the constraint, plus 
the fact that 

s{t).a{t) = (IV. 10) 

We have, in the original basis: 

= -Hi-jaj - — > —r-Siai (IV.ll) 
dt ^ ^ N ^ dt ^ ^ ' 
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where 



dsidsj 



(IV.12) 



is the effective Hessian for a spherically constrained system. The last term in (P!V.11|) serves 
to impose the preservation of the constraint, and tends to zero with time. 
For this model the Hessian reads: 



H, 



-Jij + z{t)6i 



(IV.13) 



We note that H is time-dependent (through z), but its eigenbasis does not depend on time. 

We now know the structure of eigenvalues of the Hessian for all times: Pt(A) is a shifted 
semicircle law with support in the interval [—2 + z{t), 2 + z{t)]. The distribution is, for large 
times, a semicircle starting in 



X„ 



(IV.14) 



and extending up to A ~ 4. The number of negative eigenvalues goes as ~ Nt^^^'^. The 
limiting form of the distribution, /9oo(A) is a semicircle with support in [0,4]. 

Let us now discuss how the long-time structure of the Hessian is reflected in the response 
and correlation functions. Consider the effect of a small kick on the system at time t^i, 
in the direction of the magnetic field of intensity Ah and duration At. It will shift the 
configuration Siit^j) to + crj(t^), where (^^(t^) = Ah At. The response function at 

subsequent times is the increase of magnetization due to the field, per unit of Ah At, i.e.: 



R(t, 



Ah At N 



Si cri(t)ai(t^ 



We can now solve eq. ( [1V.11| ), neglecting its last term, to get: 



cr, 



H(r)dr 



aj{t^) 



(IV.15) 



(IV.16) 



Leading to: 



R{t, 4 



-/* H(r)dr 



CTjity,) 



(IV. 17) 



Because the eigenbasis of the Hessian is uncorrelated with the direction of the magnetic 
field, this becomes, in the large limit: 



= tr I 



-/* H(r)dr 



<H>t,tu, (t—t-w) 



(IV.18) 



where the tr± denotes the trace restricted to the directions tangential to the sphere, and we 
have defined the time-averaged Hessian as 
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Hij{T)dT 



(IV. 19) 



It is clear that in ([IV.18|) the contribution of the tail of low eigenvalues of the averaged 
Hessian is negligible for finite time-separations t — « t, and that we can for these 
time separations substitute the averaged Hessian by the asymptotic (semicircle) distribution 
Poo('^)- Hence, we find that the fact that Pt(A) has a limit implies time-homogeneity in this 
regime of times. Furthermore, the fact that Poo{\) oc A^^^ for small A (but large compared 
with 1/t) implies that R{t — t^) (x {t — 



-3/2 



For time-separations oit — t^ of the order of t, the exponential in ( |IV.18| ) selects the tail 
of lowest eigenvalues, and the FDT regime breaks down: the tail of almost flat directions of 
H is responsible for the 'aging regime' t — t^ = 0{t). 

For this simple model, the calculation can be carried out explicitly, using the asymptotic 
form for H at long times: 



< Hij >t,t^ {t - t^) = -Jij{t -t^) + I z{T)dT 

-■^ til! 



5i 



3 t 

[-Jij + 25ij\{t -ty,) - - 6ij In — 



(IV.20) 



from which an expression for the aging regime can be readily found. 

Let us now turn to the 'fast' correlation function at small but non-zero temperature and 
at two large but not very separated times. Because the motion along the fiat directions 
is slow, it can be neglected for short time differences. On the other extreme, one can 
assume that the system is equilibrated in the 'fast' degrees of freedom corresponding to 
large eigenvalues of H. Since, as we have seen, in this regime of times it is only such degrees 
of freedom that also contribute to the response function, we conclude that FDT must hold. 
The correlation function then reads: 



C{t,t') = 1 - T f' R{t,t")dT 
Jt' 

T tr^ [ dt" 
Jt' 



- C, H(r)dr' 



(IV.21) 



Since t — t' is by assumption << t, we can neglect the variation of H to get: 



CM 



Ttr^ {H-\t) 



1 



^H(t) {t-t') 



A„ 



(IV.22) 



We can now check that the assumptions we made above are consistent: for t — t' finite 
and large t, the numerator in (|IV.21| ) acts as a low A^ cutoff: the (few) positive and negative 



A^ that are close to zero 0{l/t) do not contribute. As t — t' becomes comparable with t 
the approximation (and hence the validity of FDT) breaks down because on the one hand 
we can no longer suppose the constancy of H, and on the other hand the slow degrees of 
freedom (A^ ~ 0) start contributing and we cannot assume that they are equilibrated. 

The inverse eigenvalue 1/A^ is the typical length of the fluctuations in the direction fi, 
it is infinite if A < 0. The Edwards- Anderson parameter is: 
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qEA= lim limC(t,t') (IV.23) 

The quantity 

S - (IV.24) 

precisely measures the average width of the channel, the order of the limit ensures (via the 
numerator in ( [1V.22D ) a cutoff in the directions in which the system is unbound, i.e. it 
selects the 'walls' of the channel against the longitudinal direction. Note that in this model 
there is no discontinuous process of escape from a trap. 

Finally, let us discuss the question of ergodicity breaking. As we have noted already, the 
separation between minima is of order 0{N^^^), while the energy above the minima is, for 
large times AE{t) ~ ^A^, well above the barrier. In this model we can also ask ourselves 
about ergodicity in the other sense of section |T|: whether there is the possibility at non-zero 
temperature, of changing basin spontaneously. 

We have seen that it is the sign of si (in the eigenbasis of Jij) which defines the basin. 



The evolution of si is, for finite temperature T given by (see II. 4 of ref. |Tl|): 

si(t) = Sl(^ = 0)e-/o'^-W-)-2)'^- 



+ 



f' dt"e- '^-(^(-)-2),^(t") (IV.25) 





The first term is deterministic, while the second is a Gaussian random variable with variance: 

2T f df'e-^t"^^'^^^-^^'^^ (IV.26) 

JO 

a quantity of order one. Hence, there is at any finite time the probability that si(t) will 
change sign (unless, of course, the system started well-within a basin: si{t = 0) = 0{\/N) 



V. P-SPIN MODEL 



The spherical p — spin model |jT2|, unlike the previous two, has many (exponentially with 
A^) |T5[ minima. The Parisi ansatz for the replica solution has a one-step replica symmetry 
breaking. 

The long time out of equilibrium dynamics has, again, in the low-temperature phase, 
two regimes of times: 

i) for t, t' — >■ oo and t — t' finite the correlation and response functions are time- 
translational invariant, and satisfy FDT. At zero temperature and large t — t', but still 
<< t, also for this model: 



C 



FDT 



+ A{t~t')-'^' ■ RFnTOcit-t')-'^' 



(V.l) 



The relaxation exponents change with temperature and are given in pi 
The dynamical Edwards Anderson parameter (T ~ 0) 



p{p - 1) 



(V.2) 
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as well as the asymptotic 'threshold' energy density 



/ 2(p-l) 

P 



(V.3) 



are different from their corresponding Gibbs-measure counterparts. We shall re-derive them 
from a geometrical point of view below. 

ii) For widely separated times, the correlation becomes smaller than Qea, and is not 
time-translational invariant. The response function in this regime also violates FDT, and, 
unlike the previous case, yields a long-time memory with aging effects that are similar to 
those experimentally observed in real spin-glasses. 

Structure of minima 

The system has many minima, ranging in energy density from the ground state ecibbs 
(as calculated in the replica calculation) up to a threshold energy Cthres |p^ , p^ , p3| ( |V.3| ). 
The corresponding Edwards- Anderson parameters of these states are given, in terms of the 



energy density of each minimum e by [|14 

1 - Qea _ _ 
P 



T 



hi- 



-'thres 



(V.4) 



The asymptotic energy, as well as the dynamical Edwards-Anderson parameter tend to 
the values ( |V.3D ,( [V^ corresponding to the threshold states, though the system never relaxes 
into any of these \\L3\\. 



Using the equation of motion, and the spherical constraint, one has that the Lagrange 
multiplier z{t) is related to the energy density by: 



z{t) = -p e{t) 



(V.5) 



The energy Hessian can be calculated by expanding up to second order around a sta- 
tionary point and using the spherical constraint, to get (cfr. ( [1V.12D ): 

H., = ^ + zm, (V.6) 



dsjdsi 



Using the homogeneity in the expression for the energy, we first note that the equation 
of stationarity implies that H has an eigenvector in the 'radial' direction Sj of eigenvalue 
-p{p-l)z{t). 

We can find the spectrum in the directions orthogonal to this one by using the 'locator 
expansion' [Q, or directly by noting that ^f-^ is a sum of many (~ A^^~^) terms, and hence 
assuming that in the directions orthogonal to s the couplings can be taken as uncorrelated 
from the configurations in the large N limit (this is indeed the assumption in [^). The 
mean-squared element can be obtained from: 

2 

E E •Jii,...,ip-2'^jl,: 

ii,...,ip_2^i,iii,...,jp-27^j,i 

si 2 



dsidsj " 




.,jp_2'5ii. 



.S 



Jp-2 



NP- 



p\ 
2NP- 



ip-2)\ 



2N 



(V.7) 
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where we have used the variance of the couphngs, and the factor (p — 2)! counts the number 
of ways of matching the {ik} with the {jk}- The matrix of second derivatives is then 
a random matrix whose distribution of eigenvalues is a semicircle law with support in 



'2p{p — 1), +^j2p{p — 1)], plus a projector in the direction of s. 

Using ([V.5| ), ( [V.6|) , ([V.7| )) and (|V.3|) we find that the spectrum of the Hessian Pe(A) in 
the direction tangential to the constraint is a shifted semicircle law with support in 

P{ethres - e) < A < -p{ethres + c) ; Xmin = P{ethres - c) (V.8) 

A direct calculation using: 

^-<l-^-fdxP^ (V.9) 



TJX 



yields back ([V.4|) . A more complete confirmation of (|V.8| ) can be obtained by making a 



low-temperature expansion around a minimum and checking that using the form of Pe{X) 



one gets the same results as in the TAP approach of [|T^. 

We now understand the origin of the threshold level: the 'gap' in the spectrum of the 
Hessian becomes smaller as one considers states that are higher, until it disappears at the 
e = ethres- Above the threshold the gap is negative: those critical points are unstable and 
their index increases with increasing energy. 

Finally, we can estimate the energy difference between the critical points of index / and 
the highest threshold minima. Using Xmin from ( |V.8| ) and the semicircle law one easily gets: 

I = N dX pi{X) N dX A^/^ 

I (xN{ei- ethres?'^ El- Ethres <xP/'N'/^ (V.IO) 

In particular, we have for the barriers separating threshold minima (/ = 1): 

Ej=, - Ethres N'^' (V.ll) 

Out-of equilibrium Dynamics 

In order to study the long time dynamics starting from a random configuration, we 
start by considering the Hessian given by ([IV. 1 1|) and (|1V.12| ). The calculation of the time- 



dependent spectrum of the second derivatives of the energy is obtained by making as in the 
preceding section the assumption of independence of the configurations and couplings in 
the large-iV limit. Repeating the calculation ( |V.6D for this case, we find that the Hessian 



consists of a random matrix of elements with variance as in (|V.71) plus a shift term. The 
eigenvalue density pt{X) is then a semicircle law with support in: 

p{ethres - e(t)) < X < -p{ethres + e{t)) ; Xmin{t) = p{ethres - e(t)) (V.12) 

This assumption is confirmed numerically in Fig. 5 , where we plot the integrated spectrum 
of the Hessian for different times. In the inset we show the integrated spectrum of the matrix 
of second derivatives of the energy (i.e. the spectrum of H minus the shift) and compare it 
with an integrated semicircle law. 
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-2.0 0.0 2.0 4.0 

FIG. 5. Integrated eigenvalue (A/a/3) distribution of the Hessian at 10 different times for 
p=3 and N=200. Inset: the shifted distribution for all times and the analytical integrated 

semi- circle law. 

We are now in a position to rederive some results for the out of equilibrium dynamics of 
||T3| : If we now claim, as in the preceding sections, that because of the dominance of borders 
the dynamics is such that the Hessian has a (decreasing) number of negative eigenvalues at 
all finite times, we reobtain the 'marginality condition': 

lim e{t) = ethres (V.13) 

At this point it is important to remark that this last equation does not mean that the 
system relaxes into a near-threshold state: at all finite times an infinite system has a Hessian 
with an infinite number of directions in which the energy is a maximum. If at a given finite 
time the system is close to a border dj, we may ask how many different basins meet there, 
i.e. to what extent the system is 'almost undecided'. A study |^ of the random partitioning 
of a high-dimensional space suggests that generically / + 1 basins meet at dj - an infinite 
quantity at finite times. 

We have seen that the saddles separating threshold minima are typically 0{N^^^) above 
the threshold level, while the energy is at all finite times 0{N) above this level. Again, 
we confirm that at all finite times the constant-energy surface is not disconnected into 
components. 

Up to now the system seems to behave dynamically in a very similar fashion to the p = 2 
model. An important difference appears when we consider the evolution of the eigenbasis 
of the Hessian. Because the actual elements of the second derivative matrix now depend on 
the time via the time-dependence of the spins, we may expect that unlike the case p = 2 
the eigenbasis of H also depends on time. Indeed, (see Fig. 6) the overlap of the eigenvectors 
at two different times {t,t' such that C{t,t') ~ 0.7) are very small. Although the spectrum 
of the Hessian leads us to an image of a 'channel' whose characteristics change slowly with 
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time (as in the case p = 2), we now see that such a channel twists and turns chaotically 
with time. 



200 



100 




uTt')U(t).. 

-1.0 -0.5 0.0 0.5 1.0 "J 

FIG. 6. The statistics of overlaps between the eigenvectors of the Hessian, at two times 

{[W{t')U{t)]ij vs i), for p=3 N=200. 

Let us now turn to the analysis of the 'fast' relaxations (the quasi-equilibrium regime). 
We have seen in the preceding section that what is relevant for this regime is the spectrum 
of the time-averaged Hessian (cfr. (|1V.18| ) ( [1V.19| ) and ( [1V.22| )). Since for this problem 
the eigenbasis of the Hessian turns, in principle we have to take care of the fact that the 
spectrum of the time-averaged Hessian is not the same as the time average of the spectrum. 

The spectrum of the averaged Hessian can still be obtained with the same assumptions, 
but taking into account in (|V. 7| ) that the spins are evaluated at two different times. This 
will introduce a factor ~ C{t,t')^~'^. However, since we are here interested in the regime of 
times for which C{t,t') > Qea, and we are restricting ourselves to near-zero temperatures, 
the effect of the variations of the configuration (and hence the 'turning' of the Hessian) can 
be neglected. Following then a calculation as in the preceding section, we reobtain (|V.1|) . 

Hence, we see that the fact that the form of the steepest 'walls' of the 'channel' preserve 
their form (even if the channel twists) explains the validity of the fluctuation-dissipation 
theorem and time-translational invariance in the quasi-equilibrium regime. 



VI. CONCLUSIONS 

In this paper we have argued that the relaxational dynamics of a system in the ther- 
modynamic limit has characteristics that lead naturally to slowing down and are a direct 
consequence of the infinite-dimensionality of phase-space. 

The peculiarities of infinite-dimensional geometry may be overlooked if one seeks for 
inspiration from a low dimensional phase-space sketch: such a sketch for a ferromagnet 
would consist of a double well and would lead us to conclude that after a rapid quench the 



21 



ferromagnet 'falls' into one of the states, though we know that this does not happen in finite 
times. 

In the case of a ferromagnet, we are kept from jumping into wrong conclusions by a pic- 
ture of snapshots of the domain structure at different times - a naturally infinite-dimensional 
description of a configuration. At present it is not known if every form of slow dynamics 
present in nature is just some sophisticated version of domain growth (cfr. the long-lasting 
controversy with spin-glasses): hence the interest of trying to explore the consequences of 
infinite-dimensionality of phase-space directly, without invoking real-space structures. 

In order to isolate these phase-space geometric causes of slowing-down (which do not 
involve rapid jumps) from barrier-crossing mechanisms, we have deliberately concentrated 
on systems which have a non-Arrhenius behaviour at near-zero temperatures. On the other 
extreme, there is a picture by Bouchaud |Q of jumps between phase-space traps which is at 
the same time simple and yields excellent results for spin-glasses. 

Whichever turns out to be the complete description of the problem of slow dynamics, it 
will have to take into account all elements, blending continuous and discontinuous trapping 
together in a single picture - possibly with each correlation scale dominated by one type of 
mechanism. 

Let us finally remark that though it seems important to have a phase-space intuition of 
what happens with a system that ages, it will not substitute a dynamical computation: by 
the time one introduces all the necessary elements that go into the definition of a 'barrier', 
one has taken into account all the paths leading to it and their respective probabilities: 
precisely what one computes in a dynamical calculation. Moreover, if as we have argued 
here the saddle-points are also relevant, in order to know their structure we are faced with a 



Morse-theory problem that is again best studied ||2J] using methods that are closely related 
to Langevin dynamics. 

ACKNOWLEDGMENTS 

We wish to thank J. P. Bouchaud, L.F. Cugliandolo and M. Mezard for discussions and 
suggestions. 



22 



REFERENCES 



[1] L. C. E. Struik; ^Physical aging in amorphous polymers and other materials', Elsevier, 
Houston (1978). 

[2] L. Lundgren, P. Svedlindh, P. Nordblad and O. Beckman; Phys. Rev. Lett. 51 911 
(1983). 

M. Alba, J. Hammann, M. Ocio and Ph. Refregier; J. Appl. Phys. 61 3683 (1987). 
[3] D. S. Fisher, D. Huse; Phys. Rev. B 38, 386 (1988); 

D. S. Fisher and D. Huse; Phys. Rev. B 38, 373 (1988); 

G. J. Koper and H. J. Hilhorst; J. Phys. France 49, 429 (1988). 
[4] J-P Bouchaud; J. Physique 2, 1705 (1992). 

J. P. Bouchaud, D.S. Dean; J. Physique I (France) 5 (1995) 265. 
[5] P. Siban; Phys. Rev. B 35, 8572 (1987); 

K. H. Hoffmann and P. Sibani; Z. Phys. B 80, 429 (1990). 
[6] CM. Newman, D.L. Stein; Phys. Rev. E 51, 5228 (1995). 

[7] A. Barrat, R. Burioni and M. Mezard; |cond-mat 9509142] , submitted to Journal of 
Physics A. 

[8] A.J. Bray, Adv. in Phys. 43, 357 (1994) 

[9] J. M. Kosterlitz, D. J. Thouless and R. C. Jones; Phys. Rev. Lett. 36, 1217 (1976). 
[10] S. Ciuchi and F. de Pasquale; Nucl. Phys. B 300 [FS22], 31 (1988). 
[11] L.F. Cugliandolo, D.S. Dean; J. Phys. A 28, 4213 (1995). 
[12] A. Crisanti, H-J Sommers; Z. Phys. B 87, 341 (1992). 
[13] L.F. Cugliandolo and J. Kurchan; Phys. Rev. Lett. 71, 173 (1993) 
[14] J. Kurchan, G. Parisi and M. Virasoro; J. Physique I (France) 3 (1993) 1819. 
[15] A. Crisanti, H-J Sommers; |cond-mat 9406051] . 

[16] The fact that initial random conditions are near borders was already noted in the study 

of fracture; see B. Derrida; J. Phys A 20 (1987) L721. 
[17] Some consequences of this are discussed in: G. Parisi; ]cond-mat 9412034 . 
[18] H. Horner; Z. Phys. B 66, 175 (1987). 

M. Freixa-Pascual and H. Horner; Z. Phys. B 80, 95 (1990). 
[19] There is a large bibliography on quantum wires, see e.g.: 

D.W.L. Sprung, Hua Wu and J. Martorell; J. Appl. Phys. 71 (1), 515 (1992). 
[20] M. L. Mehta; 'Random matrices and the statistical theory of energy levels' 

(Academic, New York, 1967). 
[21] A. Crisanti, H. Horner and H.-J. Sommers; Z. Phys. B 92, 257 (1993). 
[22] A. Bray and M.A. Moore; J. Phys. C 12, L441 (1979). 
[23] T. Aste and N. Rivier; J. Phys. A 28 (1995) 1381. 
[24] E.Witten; Nucl. Phys. B 202, 253 (1982). 



23 



